NUMERICAL ANALYSIS 


Numerical analysis is the study of algorithms that use numerical calculations to approximately 
solve the complex problems involving complex equations, functions and calculations. 


Analytical solution: Solving a problem using mathematical theorems, finding the general form 
of a problem. Value at specific point and condition can be found by applying problem specific 


values at the closed form. 


Numerical solution: Solving a problem without finding a closed form solution. The actual 
problem is solved at limited interval using numerical algorithms. 


Analytical solutions: It is not possible to solve all problems analytically. Some acceptable 
hypothesis are made at engineering problems so that 1t can be solved analytically. 


Numerical solutions: We can use numerical algorithms to find a required solution value 
needed for design. Unfortunately, numerical algorithms does not always converge to solution 
of the problem at required point. 

1) DIGITS , APPROXIMATIONS, ERROR AND TAYLOR SERIES 


1.1 Significant Figures and Decimal Figures. 


Significant figures: The figures that can be used with confidence. We are sure that the figure 
has the close value to the actual result. 


Example: What is the length of the pencil? 


Ruller 16 17 18 


Example: State the number of significant digits of some number representations. 


Decimal places: It is the number of digits used to represent a number. Sometimes it is 
required to designate the number of digits used after a point. These degits can be significant or 
not. 


Example: Same numbers 


1.2 Accuracy and Precision: 


Precision 


1.3 Approximation: Approximation is the use of a numerical method to find a number closer 
to the exact value of a problem at hand. The result is an approximate number. 


Example: What is the value of x ? 
Babylon : 3 (close) 
Chinese : 22/7 =3.14 (other digits are meaningless) 
Indian (20" century) : 3.14156 
1 242 SX (4k)!(1103 + 26390k) 


m 9801 2 (k!)43964% 


1.4 Error Definitions: 
Error is the measure of deviation from an actual value. 
a) True Error (E)) : Is the difference between the actual values and the approximate values. 
E; = True value — Approximation 


Example: A company owner wants to hire a mechanical engineer. He will give responsibility 
of the firm manufacturing. For that, 2 candidates are given tasks to perform manufacturing 
jobs. 


1) First candidate is given a job to manufacture a nail with 31.50 mm length. At the end of 
manufacturing, first candidate manufacture the nail with 32.08 mm. What is the true error of 
the manufacturing? 


E, = True value — Approximation 
E, = 31.50 — 32.08 = —0.58 mm 


11) Second candidate is given a job to manufacture a nail with 1.20 mm width. At the end of 
manufacturing, first candidate manufacture the nail with 0.76 mm. What is the true error of 


the manufacturing? 


E, = True value — Approximation 
E, — 1.20 — 0.76 — 0.44mm 


iil) As a firm manager, who do you hire? First candidate or second candidate? Discuss. 


b) True Fractional (Relative) Error (sı) : It is the fraction of error with respect to true 
value. 


Bes True value—Approximation 
t True value 


Example: Let us calculate true fractional error this time. 


) === -0.0184 
i) === 0367 


c) True Percent (Relative) Error (%¢;) : It is the representation of true fractional error in 
percent form. 


True value—Approximation 
HE, = nı, 


True value 


Ve, = &,x100 


Example: Let us calculate true fractional error this time. 
_ 31.50-32.08 


1) Ef = — x100 = —1.84% 
ii) = I — 36.796 


***** Ty numerical analysis, we generally don’t know the exact value of the problem. We 
have to change error definitions for that purpose. 


d) Approximate Error (E,) : Error calculated from the approximate values of the problem 
throughout the approximation process . 

E, = Current Approximation — Previous Approximation 
Similarly with the true error definitions; 


e) Approximate Fractional (Relative) Error (sa) : It is the fraction of error with respect to 
approximations. 


es Current Approximation—Previous Approximation 
a Current Approximation 


f) Approximate Percent (Relative) Error (%g,) : 


Current Approximation — Previous Approximation 
Ub = FD HI 1002, 
Current Approximation 


Example: Maclaurin series: Exponential function. 

2 3 4 n 
e =1ltxt ot oe ogee 

201 83 41 n! 
We want to calculate el” using Maclaurin series. Starting from the first expression and 
adding a term at each approximation, calculate el" , We can select true value of 
e!8=5 9289856419 as each digit of this number is significant. Calculate error definitions 
of each approximation. (Use 3 significant digits at error calculations) 
1* Iteration: 


e*=1  (itcontains error, can it be acceptable?) 


E, — 5.9289856419 — 1 — 4.93 
5.9289856419 — 1 


— 274579291 7 _ 0.831337 = 0.831 

Et = "5 9289856419 

gere RIA ub dad an 
AR 9289856419 ^ m .-— 

sıx 

Ea =X 

Na = X 


2" Tteration: 


e*=14+x=1+1.78= 2.78 


E, = 5.9289856419 — 2.78 = 3.15 
— 5.9289856419 — 2.78 o_o ans 

Et = — 9289856419. m. 
%E, = 2289550113 7 248. 400 08311700 553 1% 

söz 50289856419 — 77 -. 
E. =278=1=1.78 

278-1 

E, = = 0.640288 = 0.640 


278 
%e, = 275 x100 = 0.640288x100 = 64.0% 


2.78 


3" Tteration: 


x? .78? 
er=14+4x1+>3=1+178+ = 4.3642 


E, = 5.9289856419 — 4.3642 = 1.57 
5.9289856419 — 4.3642 
= AAA AAA 0.263921307 = 0.264 


Et = S 9289856419 
Ope, — 289856419 43642 100 — 0.263921307x100 = 26.4% 
$ö” 99890856419. ^ 77 -—-. 
Eu 63642 — 270 = 158 
4.3642 — 2.78 
pn. 0362000506 


4.3642 


4.3642—2.78 
4.3642 


Ea = x100 = 0.362999x100 = 36.3% 


4" Tteration: 


x? x? 
X ~x E == 
e~=14+x+ 2 + 31 
1.78? 178? 
e178 = 1 + 1.78 + m + — = 5.3041587 


E, = 5.9289856419 — 5.3041587 = 0.625 
5.9289856419 — 5.3041587 
B — - 0.105385139 = 0.105 


im 5.9289856419 
5.9289856419 — 5.3041587 
0€t = — — 59289856419 “100 = 0.105385139x100 = 10.5% 


Ea = 5.3041587 — 4.3642 = 0.940 
5.3041587 — 4.3642 
= ooo. = 0.177212 = 0.177 


fa = 5.3041587 
= 2304158743642 4100 = 0.177212x100 = 17.7% 


06g, = 
0*a 5.3041587 


5" Iteration: 


x2 x xl 
x= = = .— 
e See Say Ta 
1.782 1.78% 1.784 
e178 = 1 + 1.78 + 2 + 2m + u = 5.7224403 


E, = 5.9289856419 — 5.7224403 — 0.207 
— 5.9289856419 — 5.7224403 


= = OGSSEZIIG = 0.0348365439 = 0.0348 
py ae PERROS O ARAS o ABAD 232460) 
aim 5.9289856419 —. ——. 


Ea = 5.7224403 — 5.3041587 = 0.418 


5.7224403 — 5.3041587 
= —vc.— — — = 0.073095 = 0.0731 


fa 5.7224403 
YE. x HA x100 = 0.073095x100 = 7.31% 


6" Iteration: 


D NES SAN MIS 
e* = Itxt4 tua tar ug 
RU 1,78%. 178% 1.78* - 178" 
e cbe pr co "ap TEES 
E, = 5.9289856419 — 5.8713485 = 0.0576 
5.9289856419 — 5.8713485 


— 5.8713485 


= = 0.0097212441 = 0.00972 
59289856419 
5.9289856419 — 5.8713485 
0€; = — —$9289856419 “100 — 0.0097212441x100 — 0.972% 


Ea = 5.8713485 — 5.7224403 = 0.149 


5.8713485 — 5.7224403 
= ————————————— = 0.02536185 = 0.0254 


7 PE E s 
%E, — ———— x100 = 0.02536185x100 = 2.54% 


5.8713485 


7" Iteration: 
ELLA MA where to stop! 


1.5 Tollerance (sə): 
It represents the range of error that can be acceptable for the result. VVhen comparing vvith 
the tolerance, absolute error is considered. 


|El € es stop 
or 
leal € Es stop 
Which error should we use? 
*** [n numerical analysis used in engineering, we can not avoid 2 sources of error. 


1) Truncation error: We can calculate all the terms of the algorithm, we have to stop at 
some point. Similarly, we can not show all the digits of the number, we have to stop digit 
at some point. 

11) Round-off error: We deliberately change the last digit of the number by looking at the 
following digit. The significant value is not represented correctly but the error involving 
the number is minimized. However, at each new calculation with the number, the results 
deviate from the actual value. 


Example: The results is : 398.2608317347328783426909210783467331231253465........ 
goes on. 


Truncation : we have to cut the digits. 
398.260831 /cut/ ..734732878342690921078346 
Result is: 398.260831 (truncated, all significant) 
Round-off : 
398.260831 /cut/ ..7/decide/34732878342690921078346 
Result is: 398.260832  (round-off digit, last digit is not significant but error is 
reduced) 


1.6 Taylor Series: 

Consider a function which is both continuous and differentiable. (if not?) 

Purpose: We want to find the function value using the properties of the function at a 
different point. 


We want to relate the properties of the function at a given point such that we find the 
function value at another point. 


Function is known but 
Its character is not 
known Pd 


Relate? 


h 


x 


(xi) 


x+h 
(Xiz) 


Taylor series expanded at a point to relate the function value at another point is given as: 


h? h? h” 
fG € h) = fG)  hf'G) OO EO) 


-—————— — o) 
o" 1 st 2nd gr n? 
order order order order order 


Or it is sometimes better to show indices as: 


f Gua) = fx) + hf T Qu) e I f" Gu) ++) where 
h = xı “xi 


Continuous, differentiable, progress 


y=f(x) 


In numerical analysis, convergence of taylor series is dependent on “h”. If h-->0, series is 
convergent. If h>1, the series may diverge and this is also dependent on the derivative values. 


Taylor series with error term added: 


h? h? h" 
FG b) = fG) + RPG) € 7 FG) z P0) +--+ SFR) 


truncated 
hs 
forme 
Fan + D 
Here, true error defined as: 
= +1 
Rn = cw E) where x<¿<x+h 


This term can be calculated from “mean value theorem". Consider the TSO expansion series with: 


f(x +h) = f(x) which contains E; 


y=f(x) 


TSO 
Prediction 


(xi) (in) 


y=f(x) 


Prediction TSO 


Prediction 


X+ 


(xi) Zin) 


Comparing exact prediction with derivative values at boundaries: 

f'(x) 2 Exact prediction 

f'(x+h) < Exact prediction 
As function is continuous, the derivative values are continuously changing between f(x) and 
f (x+h) inside the interval. There exists a point inside the interval where the derivative value at 
that point is equal to exact prediction. 


y=f(x) 


(xi) (in) 


The derivative values of the exact prediction can be written as: 
Slope of exact prediction = f'(£) = E,/h 
Therefore true error of TSO expansion can be written as: 
E, = hf'(€) (the exact error of TSO) 


Higher orders? 


Example: We want to find function value at point x=3 of the following function using Taylor series 
expansion at point x=2. Starting from 0" order of expansion, calculate approximate value of f(3) until 
true error satisfies the tolerance of £,20.1. Use 5 significant digits when necessary. 

f(x) = x”7 — g05x 


Taylor series Expansion: 
x=2 , X+h=3 h=(x+h)-x= 3-2=1 


h? h? jn 
f(x * h) € f(x) £ h.f'(x) HO) taf 0 zii Togo) 
Or for this problem; ` d : 


h? h? h” 
POs kart FO fer Fo 


Luckily, we can find exact value of the problem easily by: 
f(3) = 377 — e15 = 14.93733445 


1% iteration (TSO): 


f@3)=f@) 
f(2) = 227 — e! = 3.7797 


Et=14.93733445 — 3.7797 = 11.158 
|11.158| < 0.01 X Continue 


ond iteration (TS1): 


f) = f(2) + h.f'(2) 


fio A (x27 — e95x) = 2.7x17 poss 
dx 
f'(2) =2.7(2*”) — 0.5e! = 7.41318 


f(3) = 3.7797 + 1(7.41318) = 11.193 


Et=14.93733445 — 11.193 = 3.7444 
13.74441 < 0.01 X Continue 


3" iteration (TS2): 


h? 
f) = fO) v hf") +f") 
fF" == (27x17 — 0.58%5%) = 4.59x°7 — 0,25805 
f"(2) = 4.59(207) — 0.25e! = 6.7769 


1? 
f(3) = 11.193 + y (6.77698) = 14.581 


Et=14.93733445 — 14.581 = 0.35596 
10.35596| < 0.01 X Continue 


A" iteration (TS3): 


h? h? 
fB) = f) + Lf) +5 Ff") + fo) 
f "60 == (4.59x97 — 0.25e95*) = 3213x793 — 0.,125e95% 
f"(2) = 3.213(2703) — 0.125e! = 2.26998 


13 
f(3) = 14.581 + — (2.26998) = 14.960 


Et=14.93733445 — 14.960 = -0.022371 
|-0.022371| € 0.1 V Stop 


What should we write for the result? 


Example: The integral expression: 


Can be written as a function as: 


f(x) = | tetas 


1 
and f(x=2) gives the value of the first integral. Using Taylor series expansion of the f(x) function 
expanded at x=1, calculate the f(2) value with each Taylor Series term added in each iteration. 
Continue your iteration until true percent error satisfy the tolerance of ¢,=5. 


Solution: 
For this particular problem, exact solution of the integral can be found as: 


| xe*ax =e*(x—1) 
2 
İ yerds = e?(2 — 1) — e1(1 — 1) = e? = 7.389056090 .... 
1 


7.389 have accuracy well inside the tolerance. (even 7.4 is enough). 


Consider you don't know the mathematical theorem for integration and can't calculate the value. 
Taylor series expansion is one way to solve this problem. 


x 


f(x) = | reas 
1 


h? h? h" 
fath =fG)+ fa I) s f" G0 + FP) 


x=1 , x+h=2 and h=1. For this problem: 


h? h? h” 
FORPOR UR Were DA OD 


1" Iteration (TSO) 


f(2) =f 


x100 = %100 
İ1001 <5 X Continue 


2" Iteration (TS 1) 


f(2) =f) + h.f'(1) 


f"(1) = 1e! = 2.7183 
f(2) = 0 + 1.(2.7183) = 2.718 
7.389 — 2.718 


es A 100 = %63.2 
-. 7389  * - 


63.2] <5 X Continue 


3" Iteration (TS2) 


h? 
FC) Zf AFD v fq) 


d 
f" (x) = — (xe*) = e” + xe” 
dx 
f" (1) = el + 1e! = 2e! = 5.437 
2 


1 
f(2) = 2.718 + zı (5-437) = 5.437 


7.389 — 5.437 
968, = — 7389 “100 — 0026.4 


26.4) <5 X Continue 


4" Iteration (TS3) 


h? h? 
f(2) &f( + fO) * x f" OQ) vu f^) 


d 
f'"x)- a + xe") = e” + e” + xe” 
x 
f" (1) = el + el + 1e! = 3e! = 8.155 
2 


1 
f (2) = 5.437 + = (8.155) = 6.796 


7.389 — 6.796 
968, = — 7389 *100 — 068.03 


8.03) <5 X Continue 


5" Iteration (TS4) 


fa “ fG) + h.f) + H vq) + "m + R. pio) 
m I 2! 3! 4! 


: d 
FO = ə + e* + xe”) = e” + e* + e* + xe” 
x 
fr = el kel kel te! = 4e! = 10.87 
12 
f (2) = 6.796 + 7, (10.87) = 7.248 
7.389 7.248 09 = %1.90 
TF 00 
11.90) <5 Y Stop 


%E; = 


Result: 7.248 (you are sure of how many digits?) 


FYI: 

6" : 7.36201329 
7": 738466563 
8" : 7.38844102 
9" : 738898036 
10" : 7.38904778 
11% : 7.38905527 


